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ABSTRACT 

An overview is provided of the Management Information 
System for Occupational Education <HISOE) . MISOE is described as an 
interactive, computerized information system designed to be 
prototypical for the statewide management of education and to help 
managers at all levels better understand, through numerical analysis 
of past experience, the causal relationships between current policy 
and future results. Part I of the report outlines the structure and 
scope of MISOE, discussing the system's data files, its sampling 
design, and its data system index. Part II focuses upon policy 
analysis and data analyses within MISOE and describes dynamic 
simulation, a process which relates the future consequences of 
current decisions made within the context of a complex social system. 
Part III deals with the potential which MISOE has for improving the 
quality of human life. (Author/PB) 
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PART I 
A DESCRIPTION OF MISOE 
by 



WI i 1 1 am G. Ccnroy, Jr. 
Prlnclpil Investigator, MISOE 
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Fortunately, the developing and prototypical management Information 
system which John Creager, David Tlodeman and I are going to set forth for 
you today Is fatrfy well presented in the 1973-74 Winter Issue of the Journal 
of Research an d Oevelopment In Education . Given the existence and ready 
availability of this Journali we have decided that our task today should be 
to suggest the essence, scope and structure of the development we have named 
MISOE, which Is an acronym for the Management Information System for Occupational 
Education, tf the Conroy, Creager, Ttedeman trilogy succeeds, those in 
attendance who are able to focus soffie attention upon our performance will either 
be spared the dreary experience of struggling with yet another description of 
a management information system, or have sparked a desire to further pursue 
our work as a potentially useful experience* Needless to say, the reality 
of MJSOE Is the result of majiy diligent and delightful people, most of whom 
are not here today. They all contributed to the Journal ac6^unt of MISOE, 
and, together, are fundamentally responsible for MISOE^s being. 

Creager and 1 will /escribe the sc6pe and structure of MISOE, while 
TIedeman will offer observations on the challenge In MISOE to make better the 
quality of life for human beings everywhere. Specifically, I will first 
outline the data files, sample design and data system Index, and th^n 
John Creager will target his remarks to data analysis within MISOE. Creager, 
TIedeman and I will talk about dynamic simulation, a process we have incor- 
porated Into MISOE to help man understand better the future consequences of 
current decisions when dealing with complex social systems. Dynamic simulation 
Is a development of Professor Jay Forrester of the Massachusetts Institute of 
Technology. Creager will Illustrate the technique somewhat more than I have 
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time to do. TIedeman will pick up the foed forward potential of dynamic 
slfnulation and Illustrate Its potential value and chnllenge. 



It Is appropriate to Introduce a description of some of the technical 
components of MISOE with a statement of purpose. Tho single purpose of MISOE 
Is to provide a computerized, information support capability to those charged 
with the responslbl I Ity of managing occupational education at the state level. 
MISOE has been purposefully designed to support the planning process by allow- 
ing man the manager easy access both to Information and to ooeratlon^^^ to ^nM^7.^ 
tnforrDation, such that experience can influence the process of policy formulation. 
MISOE has been developed on the fundamental assumption that if man can sel f-lnltlate 
an Interaction with numerical descriptions of past experience, he wl M be better 
able to understand the likely outcomes of current policy* To try to accomplish 
this goal, MISOE has added what we like to call "state of the art" computer 
technology to provide man as manager a capacity to enter Into an Interactive 
dialogue with experience. 

MISOE conceives of resource allocation as the fundamental state level 
planning function for occupational education, I.e., assigning fundi to specified 
alternatives which are designed to cause specified outcomes to occur. MISOE 
thinks of planning a^ jncluding a description of program characteristics, a 
stipulation of the types and numbers of students to be served, and statements 
describing the desired outcomes for the students who experience the planned 
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process, as welt as the Impact of the educationally Influenced students upon 
society as a whole. Such plans must Include a description of private and 
social costs and an explicit estimation of the economic benefits for society 
and the so-called target student. MISOE provides information for planning at 
three distinct levels: 



achieve desirable societal goals. 

(2) The Overall Education Level - This planning Is usually done 
by a Chief State School Officer and staff who determine 
the optimal mix between occupational and nonoccupational 
education to attain desirable societal goals. 

(3) The Within Occupational Education Level - Planning at this 
level Is most frequertly done by a division or bureau within a 
state department";^and decides the occupations for which students 
can decide to become prepared, the specific occupational 
capabilities within programs which students can learn, and the 



program characteristics which seem most likely to facilitate 
learning for discrete groups of students. 
Finally, MtSOE has ihe audacity to consider itself prototypical for 



policy making in all education^ and assumes that occupational education Is a 
tolerated educational alternative because of its perceived contribution to 
desirable social rpah». The essence of MISOE Is to help man the manager at all 
three policy maklig ievols better under$;tand, through numerical analysis of 
past experience, the causcjt relationships -between current policy and future 




results for a complex social sorvlce, connpet 1 1 1 vely functioning In a- reasonably 
free society. 

It Is now time to outline the data files and sampling design of 
MISOE. A full treatment of our '^data rich" development can be found in the 
previously cited Journal. 

MISOE is comprised of two major and connected data systems, one we 
call the Census Data System (CDS) and the other the Sample Data System (SDS). 
CDS Is comprised of essential Information on all schools whfch meets basic 
accountability responsibilities, including enrollments by grade, occupational 
education programs, terminal performance objectives (TERMOBS) attained by 
student groups within occupations, as well as expenditures by program, 
capacity and utilization descriptions by programs ond a specification of some 
staff and student characteristics. As you probably know, It Is not easy 
to develop a Census Data System In which the Information Is sensibly 
crossed, so that a user can know enrollment by grade, sex, race and occupation. 
Too many state-wide census Information systems are merely a nonratlonal mosaic 
of compliance data, rarely providing an accurate description of oractice, 
MISOE has labored long and hard to develop a census data system which, whl le 
meeting alt compliance regu lat Ions, a Iso provl des ioforoatton for pollcv making In 
a way that Integrates occupational education with total education. COS Is 
coded so It Is maximumty connectlble and provides breakouts for a variety of 
geographical and school type variations. 

A separate word needs to be spoken about TERMOBS, or terminal 
program objectives. About three years of intensive doveiopmntal has 
yielded a flexible process by which students, faculties and schools can 
explicitly communicate specific occupational sklHs students are attempting to 
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learn within or across occupations. • Although TERM08S allow a communication of 
explicit skills for groups of students by program, they are formulated In a 
way. that does not encourage movement toward the development of constant 
standards for all students within programs. They are we 1 1 -documented In the 
Journal, and we have them fully developed for about 80 per cent of the 
enrollment In occupational education In Massachusetts, On the average, 50 - 70 
TERMOBS are sufficient to describe the occupational competency for each of the 
^ occupations for which occupational Instruction Is currently offered In Massachuset 

MISOE sample data systems are longitudinal, I.e., data Is aggregated 
to the same Individual over time. The specific data types of whal' we call * 
Generation I MISOE can probably be best understood from the framework of a 
fairly simple-minded conceptual structure we evolved, comprised of four 
separate parts: Input, process, product and impact. The MISOE Input battery 
Includes measures of achievement, ability, personality and estimations of 
socio-economic and so-cailed contextual variables, describing the student at ^ 

entry into the program. Process variables include measurement of staff 
characteristics, faculty planfulness, moonlighting. Inbreeding, technical 
experience, attitudes toward students by faculty, staff morale, Wc. The 
product battery consists of students* scores on TERMOBS, as well as a measure 
of general educationa T development « Impact Information Includes a description 
.of students' post program lifestyle, Including: economic, social, community, 
family and governmental behavior, as well as an employee rating scale which 
attempts to assQss productivity. MISOE sample data systems Include an esti- 
mation of cost by program (on a per student basis). 

In addition to the array of descriptive Information yielded by the 
MISOE design, major analytical data types include: 
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^'^ Process- Product Information - which describes relationships 

between process elements and resulting product; namely, general 
educational development, TERMOBS a^d number of completors. 
^2) Cost Effectiveness Information - which Is a way of relating 

expenditures to product. 
(3) Cost Impact <Den6flt) Information - which seeks to estimate 
the costs of occupational education to the resulting benefits 
to society or specified Individuals. The Journal Includes a 
chapter entitled "Economics of- Public Investment In Education 
and MISOE Cost Analysis Systems". 
The MISOE sampling design crosses school types (comprehensive, 
self-contalned-vocatlonal and community colleges), level (secondary, post- 
secondary and adult) with geographic region (largo cities, medium cities and 
towns). It includes forty ^schools and 15,000 students, with 12 separate 
geographic- school type cells each Including most of the high enrollment 
occupational education programs In Massachusetts, as well as a nonoccupational 
education comparison group. First stage sampling weights are the Inverse 
of sampling ratios, while a second stage of sampling Is attained within 
programs from schools randomly selected In Stage I. The weights actually 
applied to student data for computing aggre^te estimates and for conducting 
analyses relevant to the population will be the product of the first stage 
and second stage weights. Because MISOE' has decided upon two stage sampling 
with disproportionate stratification, the typical formulae for the standard 
error of commonly used statistics are not applicable. 

I would Hi<e to conclude my section of the presentation with a brief 
description of how MISOE has been designed to help man Interpret experience In 
developing policies with an im^/oved understanding of the consequences of each 



policy statement. Generation i MISOE was developed on the shaky assumption 
that Its data flies Included Important, but hardly exhaustive, elements which " 
come Into play In the development of policies for occupational education at 
the state level. As a result of a dedicated and brilliant staff, a merger of 
developed statistical and data management packages with executive programming 
Isfcomtng up' wh Ich, together with developed Iridlces to the sample and census 
data systems, as well as an array of logical and analytical operations, 
allows man the manager to browse MISOE data files In search of Information 
which could affect current policy, MISOE Is an on-line system, with a ?'scoped" 
terminal and ml nl-cpmputor, as welt as a hard copy device* Batch output Is 
also possible, and output can be tabular or graphic, MtSOE l6 being designed 
so that few technical skills dre required to enter Into dialogue with the 
data files. The Journal Includes a fairly complex example of "policy making 
with machine," 

When man as a determiner of social policy Interacts with MISOE as 
described In the Journal, hevcould be described as operating from a model or 
conception of the world at large. His dialogue with experience expands his 
understanding about the world, Hts world conceptual model Is more or less 
constrained by the number of elennents and relationships he can Juggle In his 
mind at one time. Often, the development of social policy Involves 'Juggling' 
more elements at one time than man can cognl+lvoly accommodate. Dynamic 
simulation offers a computer assisted methodology to deal with and develop 
understandings about complex social Issues, Unlike other techniques (mathematical 
programming), Its fundamental purpose fs not to specify optimum (and simplified) 
solutions to complex problems, but rather to contribute to the development of an 
understanding oo the part of human managers about the fundamental nature of 
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causal relationships among en&ments relevant to a particular social policy 
In formulation. Dynamic simulation Is technically operational within the 
hardware configuration described above^ 

Now to discuss the scope and structure of MISOE analysis alternatives 
within data flles^ with particular attention to Implications for policy making^ 
I am delighted to present the co-architect of the MISOE Sample Data System^ 
^ John Creager of the American Council on Education, Washington, 0. C. 
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PART II 



POLICY-ORIEffTED ANALYSIS 
IN AN INTERACTIVE SYSTEM 

by 

John A. Creager 
Division of Educational StatlstI 
American Council on Education 



I 



The structure and scxjpe of MISOE, as Just described by 
Dr. Conroy, constitutes a documented data base of Interconnected Information 
on students, teachers, administrators, schools, and programs. With MISOE's 
longitudinal design, the double connectabi M ty over observation units and 
time Is Just what Is needed and Is so often lacking In educational data 
bases. .tlf they are to be useful to managers of educational systems In 
policy formulation and decision making. With such a data base accessible 
to the manager via a scope terminal In his office. Information and analytic 
results can be quickly retrieved In a series of probes which he, the manager, 
defines according to his needs. The results of each probe stimulate the 
manager to define the next probe^ Thus, MISOE Is an Interactive system. 

Management Is Inherently poHcy-orlented: either the manager 

J* 

Is formulating policy, Implementing It, or eval(jatlng how It Is working. 
For this he needs the Information in the data'^'base and the results of various 
levels of analysis of that Information. Often he only needs, simple descrlpti 
Information about the domain of his responsibilities and concerns; distri- 
butional Information and summary statistics on enrollments, costs, and 
program completion or attrition such as that available from the Census Data 
System of MISOE. ^ 

An educational manager who defines his task as facilitation of 
student development will need similar statistical Information about students: 
what they are like when they enter a program, what characteristics of the 

educational process they have been exposed to, what specific skills they 

i 

have learned. And when we think of characteristics of the educational 
process, we cannot forget the teacher and administrator as Inherent parts 



of that processT Nor 'does such a manager forget that the educational process 
Is supported by a society that rightly expects something In return for Its 
Investment, I.e., Impacts on society of a skilled and productive citizenry. 
Each of these concerns can be met In part by the relatively simple descriptive 
level of analysis, using the Information In the Sarrple Data System. To know, 
qualitatively and quantitatively, what It Is one Is trying to manage and the 
level of resources available to accomplish organizational goals Is the 
first step In management. If his domain Is complex, or heterogeneous, there 
Is too much to keep In mind at once, properly sorted out In required categories, 
even if the Information Is stored In a systematic way. More likely, he has 
bits and pieces of Information sc^.ttered throughout reports and the heads 
of subordinate personnel ... I f he can Just remember where to look for the 
Information desired. How much easier to walk over to the terminal and query 
the data base, getting what he needs In the form he needs, and In reasonable 
time! 

A manager may bo faced with a definite but general problem, • • 
e.g., high overall attrition of students In occupational education. To 
analyze his problem as a possible failure of educational policy, he needs 
diagnostic listings and comparative statistics by type of school, type of 
student, and by program In order to Identify where high attrition Is 
occurring. To obtain this information, he must specify to the Information 
system the parameters of a single probe: one or rnore targets, criteria, 
output- modes, and classifications. In a comparison of attrition rates 
among programs,, the target population Is students In occupational education, 
the criteria may be the number of completors, number of non completers, 



total, and percent attrition, the output mode a tabular display at the ' 
terminal of these data, classified by program and some student type variables. 
Having obtained this Information, he may wish to examine the attrition rates 
In various schools giving this program — another probe with slightly 
changed parameters. Alternatively, he might have done both on a singlo 
probe by calling for a classification parameter of schools within programs 
or programs within schools. Further'^^bes could also determine whether 
attrition In the longer programs occurs early or late In the program sequence. 
A somewhat different kind of probe^, determining whether higher attrition occurs 
In high cost or low cost programs, capitalizes on the ability to relate the 
economic and noneconomlc component? of the data base. The manager might 
also want to compare completors and noncomp letors on Impact variables to 
ascertain the long-run nature and seriousness of the problem. 

Having thus obtained a rather more precise Idea of the nature 
of his attrition problems by working Interactively with actual data, the 
manager may now begin to play his hunches about policy changes he needs to 
make In order to ameliorate the situation. This may well Involve probes 
calling for a higher level of correlation or regression analysis. For 
example, he might want to call on stepwise regression to help pick those 
process variables, such as student attitudes toward their program or teacher 
characteristics, that might be adjusted by certain policy changes. For this 
the student might be the unit of analysis and completion vs. nonoompletion 
the criterion or dependent variable. Better yet, he might do a two-stage 
regressloo analysis, first regressing the attrition criterion on student 
Input characteristics, and then regressing the residuals on the process 
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variables. The first stage regression may be useful not only In Isolating 
student Input varlablds related to attrition, and possibly controlled by 
guidance procedures, but also In controlling the process analysis for 
such Input characteristics. Such analyses capitalize on the longitudinal 
elements of MISOE and the connectabll Ity of data across observation units. 

While time does not permit detailed delineation of the nature 
and order of probes for tfie various possible results of each Interim probe, 
one can begin to appreciate the flexibility and generality of MISOE as a 
management tool even for a particular area of concern, like attrition. 
Certainly, the choice and sequence of probes might well be different for a 
different general problem. For example, the manager may be faced with the 
complaint that cost rather than attrition Is too high. Before blindly 
supporting and Implementing a policy of wi Id ly' wielding the budgetary ax, 
he may want to look carefully at benefits as well as costs. If he must. still 
cut total costs, he may well want to adopt policies that Involve minimum 
loss of benefits. Conversely, he might develop a position requiring closer 
priority considerations of the benefits, which would then be achieved under 
a policy of minimizing costs under specified constraints. This Is not the 
kind of real problem that even a genius manager can solve by gathering 
partial and disconnected Information from the field and then staring at the 
celling. Much less can most managers afford to have at hand a welt-chosen 
and functioning research unit with Its own ad hoc computerized data base 
developed for each problem that comes along. 

The pol Icy-orlented analysis system of MISCG, designed for 
Interactive support of Management has another major feature, noted Or. Conroy, 
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and called ''dynamic MISOE." Also Interactive, dynamic MISOE permits the 
manager to look at p6Mcy Implications over time as a gestalt, by using a 
class of models called, "dynamic simulation*" These models have demonstraled 
utility In certain Industrial applications and Interesting, though specu- 
lative posstbMltles In demographic, economic, and other applications* 
Their potential for the formulation and evaluation qf educational policy 
remains to be demonstrated. The development of MISOE has envisioned such 
a possibility by providing the capability for management- Interactive generation 
of such rnodels with the data base supplying the empirical values of model 
parameters, The manager can use a given model In either of two wayss 
(I) running the model with status quo parameter values retrieved from the 
data base to ascertain long-range consequences of present policy, and (2) 
manipulating certain parameters which reflect contemplated policy chan^jes^ 
This enables him to ascertain consequences before such policy changes are» 
In fact, Implemented. In that way> he can be alerted to unexpected side- 
effects and Interactions In the system, resulting from an otherwise highly 
plausible policy change* The role of management In formulating such 
Jitedels Is regarded as critical, If such models are to be useful to manage- 
TOnt In policy decisions. 

i Although MISOE has been designed to support the manager of 

/occupational education In a particular state system, the basic principles 
of Its design are applicable to similar systems for other states, and for 
systertfe supporting managers of other levels and sectors of the educational 
enterprise. The educational researcher has a critical role In the design and 
Implementation of such management Information systems to ensure their 
-sqjentlfic Integrity, without which the manager^s Interactive use In policy 
decisions would be dangerous, rather than useful , In meeting his responslbt I l+les. 
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David V. Tledeman 
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The Ordinary in MISOE 

In one way. MISOE meroly represents an application to the 
management of occupational education of a development which has been going 
on anK>ng con5>uter circles for over two decades, namely the provision of 
compatible data files and pad<ages of statistical analyses which permit 
thorough statistical analysis of individually selected data. Tke key to 
such potential is the writing of a statistical package with allowance 
for input Of variable paran>eter designations probably appropriate for 
anticipated uses of the package. But the key to successful use of such 
packages is user faH.iUarlty with the available techniques and user 
Ingenuity in fitting his supplied or picked nu:«erical data to the structu^ 
of the pre-formed analyses. 

The Contrihiitions of HISOS 

In other way., however, MISOE strikes out'on its own in the 
history Of making computer systems adjuvant to thinking. Some of the new 
ways in which MISOE provides individuation of numerical analysis ar. quite 
obvious, others les3 obvious. Among the mo^ obvious new departures are 
the following: 

V 
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1* Introduction of the capacity to generate representative camples by 
virtue of the dvallablllty of population data and the capacity to 
deal with weighted as well as unweighted data} 

2. the raising of the regularly available Interactive capacity of 
recycling analyses to an on-line status in which the delays between 
a coaxmand and Its execution can be lowered to a state In which the 
user can quite figuratively bTdwde through data files and analyses 
in order to let his Intuition have freer play in his attempt to 
understand what his data indicate; and 

3< the Joining of analytic and diagrammatic output so that results can 
have visual as well as conceptual Impacts 

MISOE's less obvious but very powerful departures from the ordinary dn- 
velopmental lines of interactive numerical analyses Include the following: 

1. the capacity to treat product data in Ipsative terms so that the 
user can give meaning to results In terns known to 8tu<Ients and 
their parents not Just in terms of normative comparisons; 

2* the capacity CO relate costs with effects so that cost benefit and 
cost efficiency considerations can be brought into play; and 

3. the capacity to develop expectable futures to which another can 
attach the same degree of credibility as the Inventor of a possible 
future by repeating the dynamic simulation until alternative models 
are reasonably exhausted « 

The Challenge in MISOB 

But the most subtle departure from the ordinary developmental lines of 
|n{^0ractlvc numerical analysis Is MtSpBU declared plan to operate da a 



network. Data are to be assembled at local and Commonwealth levels. Compu- 
tational power is being arranged to address questions in local program in- 
vention and operation, and in legislative policy making. There are fortunately 
no present plans to restrict address of any part of the system to any class of 
user. This means that in addition to the questions appropriate to the level 
at which each works, local program administrators can ask Commonwealth and 
legislative questions, Commonwealth administrators can ask local and legis- 
lative questions, and legislators can ask local and Commonwealth questions. 
In contradistinction to present suspicions which currently limit each group 
to the questions at only its own level, MISOE can therefore materially in- 
crease communication and understanding among local and Commonwealth adminis- 
trators and legislators. Through MISOE each can satisfy himself that the 
other is doing the best he can or else generate data publicly transmlssable 
which ought to convince the party in need ol change of the bases on which 
that change ought to be predicated and pursued. 

In union with a network policy of operation, dynamic analysis offers 
visionary citizens and administrators the power to think divergently with a 
system that converges in its limits. This power stems from the fact that 
the user has to operate on his variables in dynamic analysis in order to 
move effects from a state which is not desired into another state which is 
desired. This requires that the user not alone think relatlonall3^^ he must 
think functionally as well. He must chain effects into sub-systems In 
which a causes b and b causes c, etc. Means lead to ends but in the end the 
user will find that one end In reality merely becomes the means to a larger 
end, etc. Fuph^roore, he must begin to estimate rates in order to see how 
long it will take a to become b, etc. under his asaumptions. Gitizena an4 
a4«|ni«trdtora who allow themaelvea time to become familiar with auch 



technique and thinking will find that they can chart quite considerable 
pathways Into the future with quite atrong feelings that they know what is 
likely to happen within relatively narrow time spans provided certain 
conditions can be made to exist. The effects which MISOE seeks to effect 
in citizens and adiainlatrators who would allow themselves to play with its 
capability for dynamic analyses is that which an insurance agent seeks on 
his customers, namely a look into the future and its potential and relatively 
certain consequences which is sufficiently detailed and clear to give the 
potential customer the personal conviction that he must act now, in such and 
such ways, to get what he seeks by "x" years from now. Dynamic analysis can 
build the consciences of occupational education's customers and admlnlotrators 
to such a point that they become more rational uaers and guides, not the 
somewhat irrational, network they are, and will remain, InAhe absence of 
dynamic analysis in a MISOE network. 

Although I intentionally accord MISOB great potential, I am realist 
enough to anticipate problems for MISOE as well. In order for MISOE to 
work, it must have data, not enormous sets of missing observations. It 
must be open to all users, not closed to many users. It must be consultative, 
not dictatorial. It must be synergistic, not competitive. Such conditions 
will not easily materialize. Some of the difficulties now readily 
discernible are as follows: 

1. local schools and the Commonwealth's Department of Education 
Itself must all agree to participate in MISOE for it to work; 

2. there are rather high implementative costs which must be borne 
to collect MISOE' a data, maintain its data files, and operate it 
as a consultative adjuvant interactive computational facility} 

3. there ore computational and display difficultlea of high magnitude 
which must bo worked through before the adjuvant interactive 



co"PJJ^ational facility will become as coamonplace and reliable as 
the Tefephohe; and 
4. the difficulties which naive users will at first experience will 
cause the near sighted to argue that a state -facility ought to do 
the computation for a user, not provide the adjuvant interactive 
computational capacity in which any Tom, Dick and Harry who thinks 
he can decide better than a legislator, the CoauBonwealth's Associate 
Conmissioner for Occupational Education, or a local system's 
director of occupational education can actually test jj^s assumptions. 
If we self defeatingly accept anticipated use difficulties as insur- 
nouatable, MISOE will quickly die. However, If we face these difficulties 
as good teachers face the learning difficulties of their students, namely 
as difficulties to be borne and surmounted, not as difficulties to truncate 
belief in solution, MISOE will live. If MISOE lives, educational adminis- 
tration will be brought to a new level of technical undergirding. But iJJost 
Importantly, if MISOE lives, education will be potentially returned to 
parents through their potential control of the future on a footing equal 
to that of educational administrators. When parents can function as in- 
formed and surrogate educational administrators with the resources available 
to all in a state, students will at last get the message that education is 
for and in them, not done for them by others. Education desperately needs 
the dawning of such a day. 
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